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Evaluated were variables effecting the differential 
performance of 627 educable mentally retarded Ss (mean age 14,5 
years) on a test-train-retest task designed to measure learning 
potential. Family, social, health, schooling, and testing data were 
collected for the Ss of which 75% were students in public school 
special classes and 25J6 were residents of state institutions for the 
retarded. The test designs of the Kohs Block Designs were 
administered individually three times: prior to coaching, 1 day 
following, and 1 month following coaching . Findings indicated that 
the learning potential procedure resulted in a stable assessment of 
ability to reason (as seen in the high correlation between immediate 
posttest and delayed posttest) , that 23% of the variance in the 
delayed posttest was uniquely predicted by training, that the 
training procedure did not elicit systematic differences in scores 
from children of different racial and social class backgrounds, that 
the nonverbal block designs permitted some students from poor 
language backgrounds to demonstrate ability to reason, and that 
greater than expected effects of training were demonstrated by 
children from large families. Southern-born blacks, and foreign-born 
children. (DB) 
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Demographic and Psychometric Factors Related to Improved Performance 
on the l^ohs Learning Potential Procedure''' 

Milton Budoff and Louise Gorman 

2 

Research Institute for Educational Problems 

Budoff and his associates (19 64 5 1967 5 1969 , 197 1) have 
demonstrated the relevance of a cognitive training based assess- 
ment strategy supplementary to the traditional intelligence test, 
which seeks to determine ability to reason through use of a non- 
verbal reasoning problem (Kohs Block Designs). In learning 
potential (LP) assessment, a child is seen for a pretest session, 
followed by a period of individual or group tuition which teaches 
principles relevant to solution of the problems. The child is 
posttested following tuition. Learning potential assessment 
provides ' the severely school-failing child with an opportunity to 
learn principles relevant to solution of the reasoning problems 
in a supportive context. The posttest permits the subject to 
demonstrate whether he has profited from the training by comparison 
with his pretest score. Learning potential is thus defined 
operationally > as demonstrated ability to profit from the learning 
experience. This contrasts with traditional definitions of intelli- 
gence which determine the abstractions, facts » and problem-solving 
skills expressed spontaneously by the child in a right-wrong context. 
For low IQ students , with serious academic difficulties the 
hypothesis is that the child who demonstrates increased competence 
following training on the reasoning task is more able than the 



ERLC 



2 . 

low IQ score indicates. The nongainer is hypothesized to be 
functionally more generally at the level of his attained low 
IQ score. j 

Support for the foregoing hypothesis has been provided by 
studies of the relationship between Kohs learning potential 
status and motivational variables (Harrison, Singer, Budoff 5 S 
Folman, 1972; Harrison g Budoff, 1972; Mankinen, 1971; Pines S 
Budoff, 1970; and Budoff S Pagell , 1968). These studies indicate 
that the attitudes and/or performances of the LP-designated , more 
able special class students approximate the pattern expected of 
higher IQ students. On the other hand 5 those who had failed to - 
profit from learning potential training expressed attitudes or 
performed in a manner consonant with descriptions of retarded 
children. Budoff , Meskin^ S Harrison (1971) showed that the more 
able special class students by the learning potential criterion 
performed as adequately as low school achieving 5 regular class 
children (with higher IQs) following involvement in an electricity 
course which empirically taught simple principles of electricity 
and nonverbally tested their ability to apply them. The non- 
gamers following instruction on the learning potential task and 
the electricity course operationally defined themselves as 
mentally retarded since they did not profit markedly from either 
set of experiences. Interviews regarding vocational plans 
(Folman S Budoff , 1971) and attitudes toward school (Folman g 
Budoff 5 1972) also indicated a similarity of views of the high 
scoring (LP) special class students and low achieving higher IQ 
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peers of the same chronological age. Hausman (1972) has demonstrated 
the utility of the learning potential approach with Mexican- 
Americans placed in special classes for the mentally retarded. 

The purpose of the present study was to examine demographic 
and psychometric factors related to an improved posttest performance 
by psychometrically defined educable mentally retarded (EMR) adolescents, 
after training was provided. By using multiple regression techniques 
to partition the variance of the posttraining scores , the investigators 
sought to determine the factors that accounted for the significant 
portions of this variance. 

Method 

Subjects . 

The sample consisted of 627 EMRs from nine cities and towns 
in Massachusetts. Seventy-five percent (N = 4-71). were students 
in segregated special classes in public schools • Most of the 
remainder (N = 134) were residents of state institutions for the 
retarded; 22 were participants in a community workshop. The 
subjects ranged in age from eight to forty years ^ with a mean of / 
14.55 years (SD = 2.75) ai; the time of initial testing. Fifty- / 
nine percent were males, 38% were white, and 79% had fathers who 
were manual laborers or menial service workers. Stanf ord-Binet IQ 
scores ranged from 65 to 98, with a mean of 68.81 and standard 
deviation of 10.26. 
Data collection procedures . 

Data on the following variables were collected from school or 
institutional records: place and date of birth, father's occupation. 
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race J family size and degree of inractnesSj number of diseases, 
age at entry /into special class, and WISC and Stanf ord-Binet IQs- 

Raven's Progressive Matrices were group administered by 
project staff. Sets A, Ag , and B were first administered in the 
colored format (Raven, 1956), followed by Sets C, D, and E in the 
1958 form. Total raw score for Sets A, B, C, and E was used 
in the analysis. - When an individual IQ score was not available 
within two years of the Kohs learning potential assessment, school 
or project staff tested the S_ individually. 

Kohs leai;>ning potential measure was administered individually 
to each subje The materials consisted of a test series of 

16 of the original Kohs Block Designs (Kohs, 1923), including five 
desi^gns with 16 blocks. The designs were arranged in order of 
increasing difficulty. Design 7 from the Wechsler Adult Intelligence 
Scale was added. The designs were printed on 5" x 6" white cards 
to double the scale of the original Kohs designs so that the 
stimulus designs and the block constructions were equivalent in 
size. A design of four blocks was drawn as a two-inch square; .( 
one of nine blocks as a three-inch square; one" of the 16 blocks ^ 
as a four-inch square. The four colors, i.e., red, white, blue, 
and yellow were retained • The usual one-inch cubes were used 
as the blocks. The five coaching designs consisted of three four- 
block designs (C from WISC; 3 and 7 from the Kohs sferies) and two 
nine-block designs (5 from the WISC and 8 from the WAIS). The 
coaching designs were printed in the same format and dimensions . 
as the test designs. 
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The sixteen test designs were administered individually 
three times: prior to coaching j and then one day and again one 
month following coaching. Kohs' instructions for administering 
the block design test were used at each test session (Kohs ^ 1923). 

A sample problem was demonstrated by the examiner. The child had 

/ 

to construct it correctly before the remainder of items were 
presented. Testing was discontinued after three successive 
failures. Budoff and Friedman (19 6U) present additional details 
on the procedure. 
Data analysis . 

Preliminary analysis included means and standard deviations 
of continuous variables (Table 1), frequency distributions of 
discrete variables, and an intercorrelation matrix of all variables , 
part of whirh is presented in Table 2. This matrix was then used 
in a multiple regression procedure employing the leest squares 
solution . 

A number of stepwise multiple regression analyses were 
performed against four main dependent variables: Stanf ord-Binet 
IQ, pretraining score (Kl) ^ im^aediate posttraining score (K2) 
corrected by pretraining score, and delayed posttraining score 
(K3) connected by the two prior Kohs scores. Major background 
predictors were evaluated both for their simple relationships to 
these four dependent variables and for their unique contributions 
to the variance of the dependent variables. 

Simple relationships between predictors and criteria were 
described by zero-order correlation coefficients. In order to 

the unique contributions of predictors, the set of "independent 
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variables in question (e.g., all of the age-related variables) 
were forced into the regression equation ^fter all of the other 
variables had been entered. From the remaining partials, one can ^ 
infer each variable's unique . contribution in predicting the 
dependent variable (see columns labeled "all variables partialled 
out" in Table 3). 

In specific instances, other regression analyses with selected 
independent variables and immediate (K2) or delayed CK3) posttraining 
scores as the dependent variable vjere carried out to answer 
certain questions, particularly about race and social class, in a 
more precise way. 

Improvement immediately after training and beyond was assessed 
by residualized posttraining scores, rather than by simple gain (i.e,, 
posttest score minus pretest score). The multiple regression 
technique was considered preferable to the use of a gain score 
because of the unreliability inherent in a score derived from 
the subtraction of pretest from posttest scores (Cronbach, 1970)* 
In the multiple regression context, the gain for each subject 
can be thought of as the difference between his actual score and 
his predicted score as calculated from the regression weights 
of a given equation. 

Sets of independent variables in the equations included 
chronological age, race (Black and Caucasian) , social class, sex, 
birthplace, family size (number of children) and intactness, 
number of diseases, and scores on various psychometric measures.. 
Turner^ s classification (Turner, 1964) was used as the measure of 
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social class. Variables whose distributions were extremely 
positively skewed (father present in home, mother present in 
home 5 number of diseases) were converted to logarithmic scales. 

Missing data were handled by the procedure outlined by 
Cohen (1968). Subjects v/hose scores on a variable were missing 
were given a score equal to the mean for that variable. A new 
dichotomous variable was created for each variable on which many 
subjects had missing scores; these missing data variables were 
scored as 0 or 1 , indicating the presence of absence of information 
for a subject* 

All analyses were performed an an IBM 370/155 computer at 
the joint Harvard-MIT facility, with the use of programs in the 
SPSS software language (Nie, Bent, S Hull, 197 0). 

Results 

Table 1 shows that the. mean scores (i*e., the number of 
correct designs) on the pretest (Kl) , immediate posttest (K2) , 
and delayed posttest (K3) were 3.06, 5.S6, and 5.97 (SDs-- 
2.67, 3.84, and 4.02), respectively. It was thought that there 
might be a large increment immediately following tuition-, but 
that this increment jnight be reduced considerably after an interval 
of' one month to about midway between pretest and immediate post- 
test s,core» The negligible difference between means on the 
immediate and delayed posttest s, however, showed that this reduction 

did not occur, in fact the trend is toward further increase. 

1 ^ 

Insert Table 1 about here f 
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Table 2 presents the intercorrelation coefficients among 
several of the variables. The correlation of • 7M between the 
pretest and immediate posttest on the block designs indicated 
that those Ss who solved some designs .successfully initially did 
tend to solve more designs following coaching than those who 
solved few' or no designs on the pretest. A similar correlation 
was obtained between the pretest and the delayed posttest (K3) 
(r = .74). The relationship betx>;een scores on the two posttests 
was even higher{r - .87), indicating that subjects who did well 
f on the immediate posttest also did vjell on the delayed posttest, 
and vice-versa.. 

Insert Table 2 about here 

Other significant intercorrelation coefficients (g. <-05) 
among the variables in Table 2 indicated the following relationships: 

1) Members of the sample who were institutionalized were 
significantly older t^pj^-j^ ~ -.86)5 were more often female (r^ = 

• 37), and had lower Stanf ord-Binet IQ scores (^pj^^ = *'47) than 
students in special classes. 

2) Members • of the sample v/ith intact families were younger 

(r = -^31)5 had spent fewer years in special class (r = -.31), 

tended to be males (r , . = .14), born in the Northeast (,r.. = 

pbx pbi 

• 86)5 and had higher Stanford-Binet IQ scores (r = .42) than the 
older subjects- • 

3) Students with the highest Stanf ord-Binet IQs were younger 
(r = -.36)3 not as likely to be institutionalized (^pj^^ = .47), 

O 
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tended to be born in the Northeast (r , . = .22) and to have intact 
families (r = . 42 ) • 

4) The high positive relationships among scores on the Kohs , 
Stanf ord-Binet , WISC Performance IQ, and Raven Progressive 
Matrices (.28 <r <.H5) indicated that these tests are measuring 
much of the same ability. The lower magnitude of correlations 
between these tests and WISC Verbal IQ suggest that this Aohs- 
Raven ability has a more nonverbal than verbal comronent. 

Table 3 indicates the zero-order correla**~lo':is of Stanford- 
Binet IQ and pretraining (Kl) block design scores with the 
independent variables , as well as i~he partial correlation 
coefficients for these sets of variables after, the effects of all 
other variables have been partialled out. Immediate posttraining 
(K2) block design scores were adjusted for pretest levels ^^j<j2 Kl^ ^ 

Insert Taible 3 about here 

Variables significantly related to the Stanf ord-Binet IQ 
can be contrasted with those signif icant?.y related to the Kohs 
by comparing the zero-oi^der correlation coefficients of Stanford- 
Binet IQ and pretraining Kohs scores (Kl). The Stanf ord-Binet 
score was more highly related to age, non-institutionaization ^ 
family intactness, birthplace, and WISC Verbal IQ then were the 
pretraining Kohs (Kl) score's. Kl was significantly correlated 
with sex J non-institut ionalization J family intactness, Stanford- 
Binet IQ , both WISC scores, and the Raven score* The multiple r " 
with all predictors included was .72 for the Stanf ord-Binet and 
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.57 for Kl. 

Variables related to iininediate effects of training on the 
Kchs can be seen in the r^^^^ column labeled "Kl partialled out." 
These variables were age (negative), sex 5 family size and 
intactnessj birthplace, number of diseases (negative), Stanford- 
Binet 10, WISC Performance IQ and Raven score. Variables related 
to continuing improvement in Kohs performance after the immediate 
posttest (^2^3 with Kl and K2 part'alled out) were family 
intactness, WISC Performance IQ, and particularly the Raven 
score . 

Relationships between the sets of independent variables 
and the dependent variables showed the following results: 
Age . 

Age was negatively related to Stanford-Binet IQ because the 
who 

adults/were in the institutions and sheltered workshops had 
lower IQs than the younger students who were in community EMR 
classes. Although the zero order correlation between age and 
Kohs pretest was not significant, older children and children 
placed later in special classes scored higher on the pretest when 
all other variablest were held constant. Younger children seemed 
to have benefited immediately from training (i.e., r^^^, Kl ^ ' 
However, the effect of age disappeared when the remaining independent 
variables were partialled out of the immediate retest score, and 
age was not related to continuing improvement after training 
(K3.K2.K1). The number of years in special class was not related 
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to performance on any of the Kohs tests > but was significantly 
negatively related to the Stanf ord-Binet as evidenced by the zero 
order correlation . 

Sex* 1 

/ Boys scored higher than girls on the Stanf ord-Binet as shown 
in the zero order correlation j but not when other variables were 
partialled out. Boys scored higher than girls on the Kohs 
pretest and improved more from instruction as measured by the 
immediate posttest^ with or without the effects of the other variables 
partialled out. There was no difference between boys and girls, 
however 5 in long-term effects of training on the Kohs, as evidenced 
by the partial correlation coefficients between sex and K3 . 
Race and social class . 

Race was not related to the Kohs pretest or to e±ther posttest 
score adjusted by previous Kohs scores. While the zero order 
correlation betvjeen social class and Kohs pretest was not signi- 
ficantj there was a negative relationship between social class 
and pretest score when all other variables were partialled out. 

Partial r's of race and social class on immediate (K2) and 
delayed (K3) posttraining scores, with all other variables held 
constant, were not tested because of the absence of significant 
findings for these two variables in analyses involving specific 
hypotheses. These hypotheses were tested by using race, social 
class, sex, age at pretest, and pretest scores as independent 
variables in two multiple regression equations where the immediate 
posttest (K2) and delayed posttest (K3) were dependent variables • 
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The unique variance contributed by race and social class was not 
significant. Regression equations testing the contribution 
of these two variables using other combinations of independent 
variables also yielded no significant results. 
Family size and intactness ^ 

Family size was not related to Stanf ord-Binet score. Even 
though family size did not correlate significantly with Kl ^ 
children from large families appeared to profit more from Kohs 
training, as shown by both partial correlation coefficients of 
the family size variable with K2 . This relationship disappeared 
when long-term improvement (K3) was considered. 

Children from intact families scored higher on the Stanford- 
Binet than children from broken homes , as shown by both the zero 
order and partial r. Although family- intactness rating was 
related to both Kohs posttest scores adjusted by previous Kohs 
scores, none of the family intactness set of variables showed 
a significant relationship to any Kohs score when all other 
variables were partialled out. 

Birthplace . / 

When 'pretest score alone was partialled out j children born 
in the Northeast and foreign-born children appeared to perform 
better immediately following training. When the unique con- 
tribution of birthplace is considered , however, children born 
in the Northeast benefited less from the Kohs training procedure, 
while foreign- born children profited more. There was no 
significant additional relationshii^ between birthplace and longer 
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term continuing effects of the Kohs training. 
Number of diseases . 

Children with a higher incidence of illness performed less 
well than healthy children on the immediate Kohs retest^ as shown 
by the partial r with only pretest score held constant. This 
relationship disappeared when all other variables were partialled 
out. 

Verbal and performance IQ * 

Although the zero order correlation between WISC Verbal IQ 
and Kl was significant, verbal IQ as measured by the WISC did 
not play a part in performance on any Kohs score when either 
previous Kohs scores or all other variables were held constant, 
A high Stanford-Binet score was uniquely related to immediate 
effects of training on the Kohs but not to continuing effects 
of training over time. Performance IQj whether measured by the 
WISC or Raven Progressive Matrices score j was significantly 
and. uniquely related to initial Kohs scores and to both short 
and long term improvement on the Kohs. 
Overall partitioning of variance on Kohs posttest . 

All 33 independent variables, when entered into a stepwise*' 
multiple regression equation > predicted 66% of the variance 
of the immediate Kohs posttest score j with 5.5% of this variance 
accounted for by the Kohs pretest alone. The remaining 11% 
was predicted mainly by Stanf ord-Binet IQ^ number, of children 
in the family., Raven Matrices score ^ foreign birth, WISC Performance 
IQ, sex, and age of first placement in special clas.s • All of 
these predictors had significant positive beta weights with the 
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exception of age at special class placement; the beta weight 
for this last variable was significant and negative. 

These same 33 variables, along with the immediate post-' 
training score, accounted for 8 2% of the variance o'f the delayed 
posttest score. The immediate posttest predicted 7 6% with the 
other .6% accounted for mainly by the pretest , Raven> and WISC 
Performance scores, all of which had significant positive beta 
weights. Twenty- three percent of the variance in the delayed 
retest scores was uniquely px^edicted by scores immediately after 
training . 

Discussion 

Stability of Assessment . 

The learning potential procedure results in a stable assess- 
ment of ability to reason in solving the block designs. The 
correlation of .87 between immediate posttest and delayed post- 
training scores indicates that performance following training 
yields a very stable measure. 

The correlation between immediate and delayed posttraining 
scores, holding pretraining scores constant, indicated that 23% 
of the variance in the delayed posttest was uniquely predicted 
by training. Correlations of .953 between immediate and delayed 
retest (one month interval) and .866 six months after coaching j 
have been obtained with smaller samples (Budoff 6 Friedman, 196U; 
Budoff, 1967), lending support to the finding of the present 
study that the distribution of block design scores remains 
stable after one retest.. A small sample of community special 
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class 5 school-age students yielded correlations of similar 
magnitude . 

It was not possible to assess the test-retest reliability 
without training in this study since intervention occurred with 
all subjects in the sample- Hov/ever 5 a correlation of .701 
between pretest and iiTunediate posttest scores was computed from 
the scores of a non-coached sample of EMR institutionalized subjects 
who had served as controls in the initial studies (Budoff & 
Friedman, 1964; Budoff, 1967). 

Implications of a training-based model of assessment of ability . 

Within the limits of this sample 5 the training procedure 
did not elicit systematic differences in scores from children of 
different racial and social class backgrounds. When continuing 
effects of training are considered, the Kohs procedures are not 
differentially affected by age or sex as well. The negative 
correlation of Kohs pretest scores and socio-economic status 
indicates that when middle class children appeared in the 
sample 5 they were likely to be organically brain damaged. 
Non-organically-damaged school age children who are diagnosed as 
educable mentally r^etarded come from poor and/or nonwhite 
populations. The most critical criterion used is the IQ score, 
most usually on an Individually administered test of intelligence. 
The negative correlation could also he an artifact of the low 
and narrow range of socio-economic status represented by this 
sample. 

The zero order correlations of the independent variables 
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with the Stanf ord-Binet IQ sc./res indicated that for this sample 
higher scores were associated with mores lather than less, advantaged 
social backgrounds and school settings, and with other psycho- 
metric measures. 

Scores on the pretraining administration of the Kohs 
block designs, which can be viewed as a measure analogous '^to the 
traditional IQ format (i.e., the child is expected to respond to 
the problems on the basis of what he knows or can spontaneously 
figure out), show a similar pattern of relationships. However, 
the shift to the nonverbal block designs permitted some students 
from poor and/or minority group backgrounds who attained low 
scores on the verbally biased IQ tests e.g., foreign born students^ 
to demonstrate their ability to reason when facility in the English 
language was not critical. 

Scores on the immediate post training administration of the 
block designs, when adjusted for pretraining levels and the effects 
of the other independent variables, indicate the power of an assessment 
procedure based on a training model. Greater than expected effects 
of training were demonstrated by children from large families, non- 
Northeast born children (largely Southern-born blacks) , and 
foreign-born children. The bias in performance against the institu- 
tional:^2ed child is not evident, and the effect of sex that remains 
is probably due to the more deviant functioning level of girls 
lilely to be included in a mentally retarded population* The 
relationship to Stanf ord-Binet scores is lower, though still signifi- 
cant, and Wechsler verbal IQs are no longer relate:d to posttraining 
performance. 
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Delayed posttraining scores adjusted for pre- and immediate 
posttraining scores continued to be related only to the performance 
measures, i.e., Wechsler performance IQ and Raven Matrices scores. 
The patterns of '*dis ad vant age'' most clearly evident in the relation- 
ships of the demogrciphic variables to Stanf ord-Binet IQ> and to 
a lesser extent , to the pretraining block design score are no 
longer evident v:hen the effects of the independent variables are 
partialled out of the adjusted delayed posttraining scores. 

The finding that a high performance IQ vjas highly positively 

related to performance on the Kohs after training is consistent 

with the learning potential theory that response to training on 

nonverbal reasoning problems is related to performance test skills. 

At the scime time 5 the assumption underlying learning potential 

assessment that verbal skills are unrelated to ability demonstrated 
a 

af ter/training opportunity on a nonverbal reasoning task, when the 

effects of all other variables are considered, was supported by the 

low partial correlation coefficients involving WISC Verbal IQ. 

This assumption was further buttressed by the increasingly attenuated 

relationship of Stanf ord-Binet IQ with the Kohs scores following 

training. 

Parent and community groups are now exerting great pressure 
against the use of group and individual IQ tests as estimates of 
intelligence with minority group children. Traditional IQ tests 
are described as discriminatory for these children, because scores 
depend on verbal knowledge and styles of problem solving which may 
be culturally different than those available within lower class and 
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minority group communities. The training-based model of assess- 
ment of reasoning ability, or assessment of learning potential, 
appears to have validity as an alternate, non-biased measure with 
poor, low school-achieving populations. The challenge, at present, 
is to translate this evidence of ability to profit from reasoning 
experience into more salutary formal achievements in school, in 
occupational training programs , or in careers . 
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Table 1 

Means and Standard Deviations of Continuous Variables 

Used in Multiple Regression (N = 627) 
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